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ABSTRACT 

Research  conducted  under  AFOSR  Grant  71-2116,  Control  Systems 
Theory,  during  the  five-year  term  of  the  grant,  1 July  1971  to 
30  June  1976,  is  comprehensively  reviewed.  The  work  is  classified 
into  the  two  major  categories  of  estimation  theory  and  control 
theory.  Within  the  former,  results  are  reported  in  the  areas  of 
polynomial  filtering,  adaptive  filtering,  data  smoothing,  applied 
estimation  theory,  observer  theory,  and  data  compression  and 
random  sampling.  In  the  latter,  the  focus  is  on  multivariable 
control  system  design,  and  the  research  presented  is  In  the  areas 
of  computer-aided  design,  design  theory,  control s-configured 
systems,  and  multivariable  servomechanisms.  A chronological  list- 
ing of  45  publications  and  9 Ph.D.  theses  that  resulted  from 
the  research  supported  by  the  grant  is  included. 


I.  INTRODUCTION 


This  document  Is  the  final  scientific  report  for  AFOSR  Grant 
71-2116,  Control  Systems  Theory.  The  term  of  the  grant  was  the  five- 
year  period  1 July  1971  to  30  June  1976.  The  Principal  Investigators 
were  Professors  J.  S.  Meditch  and  A.  R.  Stubberud  of  the  School  of 
Engineering,  University  of  California,  Irvine. 

The  research  conducted  under  the  grant  falls  into  two  major 
categories:  Estimation  Theory  and  Control  Theory.  Within  the  former, 

work  was  carried  out  in  the  areas  of  polynomial  filtering,  adaptive 
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filtering,  data  smoothing,  applied  estimation  theory,  observer  theory, 
and  data  compression  and  random  sampling.  The  results  of  this  work 
are  described  in  Section  II. 

In  the  category  of  Control  Theory,  research  was  pursued  In  computer- 
aided  design,  design  theory,  control s-configured  systems,  and- multi- 
variable  servomechanisms.  This  work  is  reported  upon  in  Section  III. 

A chronological  bibliography  of  all  publications,  AFOSR  scientific 
reports  and  significant  papers,  including  those  planned  for  publication, 
is  given  in  Section  IV.  It  is  noted  that  research  under  AFOSR  Grant 
71-2116  has  led  to  45  such  publications. 


In  addition  to  the  work  of  the  Principal  Investigators,  the  grant 
supported  in  part  or  In  full  the  doctoral  research  of  9 graduate  students. 
All  of  this  research  was  supervised  and  contributed  to  by  the  Principal 
Investigators.  A chronological  listing  of  the  Ph.D.  research  so  conduct- 


ed Is  presented  in  Section  V. 

II.  ESTIMATION  THEORY 

The  six  areas  in  which  research  studies  were  pursued  in  the  cate 
gory  of  estimation  theory  are  described  below.  The  name  of  the 
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Principal  Investigator  who  was  In  charge  of  each  area  Is  as  Indicated. 

1.  Polynomial  Filtering  (Professor  A.  R.  Stubberud)  . 

Research  In  polynomial  filtering  was  conducted  In  two  areas: 

a.  Synthesis  procedures  for  nonlinear  filters  in  which  the  non- 
linearities  are  constrained  to  finite  order  polynomials 

b.  Application  of  polynomial  estimators  to  covariance  identification 

a.  Polynomial  filters 

A study  was  performed  on  the  properties  of  optimal  nonlinear  filters 
which  generate  estimates  in  the  form  of  finite  order  polynomials  of  the 
elements  of  the  observation  sequence.  The  study  shows  that  practical 
polynomial  filters  can  be  generated  which  in  some  cases  are  preferable  to 
some  of  the  more  popular  filters  such  as  the  "Extended  Kalman  Filter." 
Using  truncated  power  series  expansions  and  polynomial  estimation  theory, 

a "High  Order  Extended  Kalman  Filter"  was  developed  which  can  improve 
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accuracy  over  the  standard  "Extended  Kalman  Filter."  Documentlon  of 
some  of  these  results  appears  in  [18]. 

b.  Covariance  identification 

A study  was  completed  on  the  application  of  polynomial  estimators 
for  the  plant  and  measurement  noise  covariance  elements  of  a Kalman  type 
of  filter.  A sequential  algorithm  was  developed  and  studied  on  a 
digital  computer  and  statistical  methods  were  generated  to  verify  the 
algorithm.  The  results  are  documented  in  [11]. 


2.  Adaptive  Filtering  (Professor  A.  R.  Stubberud) 

Research  in  adaptive  filtering  has  been  conducted  In  two  areas: 

a.  Adaptation  by  configuration  control 

b.  Identification  based  on  properties  of  the  residual 
a.  Adaptation  by  configuration  control 

A study  was  performed  In  which  the  confuguratlon  of  the  system  was 
controlled  In  such  a way  as  to  Improve  filter  performance.  The  technique 
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was  applied  (via  simulation)  to  a missile  launcher  system  and  a significant 
improvement  in  performance  was  obtained  over  the  a priori  system.  This 
study  was  completed  and  the  final  documentaion  of  results  is  given  in  [24]. 

b.  Identification  based  on  properties  of  the  residual 
Studies  were  performed  in  which  algorithms,  based  on  the  innovations 
properties,  were  developed  for  identifying  the  plant  parameters  and  noise 
statistics  of  a linear,  time-invariant  discrete  time  system.  One  of  these 
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algorithms  has’  a separation  property  which  allows  identification  of  the 
plant  parameters  independent  of  the  noise  statistics.  Some  of  the  results 
of  these  studies  are  documented  in  references  [28,  29,  35,  36,  40]. 


3.  Data  Smoothing  (Professor  J.  S.  Meditch) 

The  area  of  data  smoothing  deals  with  the  problem  of  extracting  use- 
ful information,  e.g.,  messages  andsystem  parameters,  from  noisy  slgnaTs 
In  such  a way  as  to  maximize  the  quality  of  the  extracted  Information. 
Research  in  this  area  w&s  carried  out  under  the  grant  along  the  follow- 
ing five  lines: 

a.  Synthesis  of  suboptimal  fixed-lag  smoothers 

b.  A detailed  survey  of  data  smoothing 

c.  Stability  of  fixed-lag  smoothers 

d.  Computational  requirements  in  sequential  smoothing 

e.  Nonlinear  fixed-point  smoothing 

a.  Synthesis 

The  mathematical  synthesis  of  fixed-lag  smoothers  for  continuous- 
time,  stationary,  random  processes  was  developed  by  Wiener  In  the  1940's. 
However,  practical  synthesis  utilizing  lumped-parameter  elements  and 
networks  Is  Impossible  since  the  smoother  Is  Infinite-dimensional.  There 
Is  also  a problem  of  Internal  stability.  A useful  approach  to  resolve 
these  difficulties  Is  that  of  approximate  or  suboptimal  synthesis  using 
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lumped-parameter  elements.  Two  such  synthesis  procedures  were  developed 
and  presented  in  [1]  along  with  Illustrative  examples.  The  degree  of 
suboptimality  (in  the  sense  of  mean-square  estimation  error)  can  be  made  . 
arbitrarily  small  by  increasing  the  degree  of  the  approximation,  i.e., 
the  number  of  elements.  Both  procedures  yield  design  algorithms  which 
are  implementable  on  a digital  computer.  The  second  procedure,  which  is 
a generalization  of  the  first,  is  quite  flexible,  but  computationally  more 
demanding.  In  particular,  it  specifies  the  synthesis  problem  as  one  of 
nonlinear  programming. 

b.  Survey  of  data  smoothing 

This  survey  was  undertaken  to  place  in  perspective  the  field  of 
data  smoothing  relative  to  the  broader  area  of  estimation  theory  of  which 
It  is  a part.  The  survey  covers  activity  from  the  early  work  of  Kepler 
and  Gauss  to  that  of  the  intensified  research  of  numerous  workers  during 
the  past  ten  to  twelve  years.  Both  theory  and  applications  were  examined, 
and  directions  for  future  research  were  indicated.  A preliminary  version 
of  the  survey  was  presented  in  [3].  The  completed  work  which  included 
over  115  references  was  published  in  Automatica  [16]. 

c.  Stability 

An  important  fundamental  question  in  connection  with  data  smoothing 
algorithms  is  that  of  stability,  particularly  Internal  stability.  Unless 
such  algorithms  are  stable,  their  computational  utility  is,  at  best, 
extremely  limited.  A study  of  this  question  was  reported  in  [9]  for 
continuous- time,  vector-valued,  stationary,  random  processes  for  fixed- 
lag  smoothing.  A realization  which  is  both  bounded- input/bounded-output 
and  internally  stable  was  developed,  and  its  use  illustrated  with  an 
example. 

d.  Computational  requirements 

It  is  well  known  that  while  smoothing  generally  yields  lower  estimation 


error  variances  than  Kalman  filtering,  its  storage  requirements  are 
more  severe.  To  ascertain  the  extent  of  these  requirements,  a quantita- 
tive study  of  the  issue  was  undertaken  for  all  three  forms  of  smoothing: 
fixed- interval , fixed-point,  and  fixed-lag.  The  results,  which  permit  one 
to  determine  storage  requirements  exactly  as  a function  of  the  dimension 
of  the  state  vector  and  the  length  of  the  measurement  data  span  are  given 
In  [12].  In  addition,  algorithmic  procedures  for  minimizing  storage  re- 
quirements are  included  in  the  results. 


e.  Nonlinear  fixed-point  smoothing 

Fixed-point  smoothing  has  to  do  with  estimating  the  state  vector  of 
a dynamic  system  at  a single  time  point  prior  to  that  of  the  most  recent 
measurement  data.  A representative  problem  here  is  that  of  determining 
the  launch  site  coordinates  of  a missile  from  tracking  data  when  the 
launch  site  is  not  visible  to  the  tracker.  A study  of  this  class  of  prob- 
lems for  nonlinear  dynamic  systems,  based  on  the  marginal  maximum  likeli- 
hood estimation  viewpoint,  was  presented  in  the  doctoral  dissertation  of 
R.  Eng  (see  Section  V).  A new,  hybrid  filtering-smoothing  algorithm  was 
derived  and  successfully  applied  to  a problem  of  real-time  aerial  recon- 
naissance data  processing  for  target  location. 

4.  Applied  Estimation  Theory  (Professor  J.  S.  Meditch) 

Two  studies  involving  the  estimation  of  respiratory  system  para- 
meters from  actual  experimental  data  were  conducted.  The  portion  of 
the  respiratory  system  involved  was  that  relating  tidal  volume  to 
alveolar  C02.  The  results  are  of  interest  in  the  study  of  pilot  stress 
In  flight  testing. 

The  first  study  [4]  included  the  development  of  an  adaptive  step- 
size,  random-search,  optimization  program  to  solve  the  associated  non- 
linear,  least-squares  estimation  problem.  The  second,  [8],  was  a survey 


of  the  field  of  frequency  response  methods  in  the  analysis  of  respiratory 
system  regulation  processes.  It  included  application  of  the  above  computer 
program  to  estimate  system  parameters  for  humans. 

5.  Observer  Theory  (Professor  J.  S.  Meditch) 

Research  in  observer  theory  has  been  along  three  distinct  lines. 

In  the  first  of  these,  basic  observer  theory  has  been  extended  to  per- 
mit state  reconstruction  for  dynamic  linear  systems  with  unknown  and 
unmeasurable  inputs  [17,  22,  23].  Potential  applications  include  control 
systems  where  it  is  neither  possible  to  model  nor  to  measure  disturbances 
which  act  on  the  system,  e.g.,  spurious  and  unexpected  wind  gust  loading 
on  an  aircraft,  radiation  from  thermonuclear  explosions,  or  communica- 
tion system  jamming  and  interference. 

The  second  line  of  pursuit  in  the  study  of  observer  theory  has  been 
that  of  initial  condition  estimation  and  interpolation  for  linear  systems. 
The  problem  of  initial  condition  estimation,  which  has  applications  in 
post-flight  data  analysis  and  trajectory  reconstruction,  has  been  thorough- 
ly studied  in  [19,  20,  33].  Both  deterministic  and  stochastic  process 
models  have  been  employed,  and  the  performance  characteristics  of  all 
known  algorithms  for  initial  condition  estimation  have  been  analyzed. 

In  the  latter  Instance,  specific  recommendations  for  applications  are  in- 
cluded. As  a follow-on  to  this  work,  observer  theory  has  been  extended 
to  permit  interpolation  of  data  in  state  and  parameter  estimation.  Two 
new  types  of  observers,  termed  initial-  and  lagging-state  observers,  have 
been  developed,  and  necessary  and  sufficient  conditions  for  their 
stability  derived  [30,  43].  The  first  of  these  new  observers  permits 
exact  reconstruction  of  the  Initial  state  of  a linear  dynamic  system. 

The  second  provides  sequential  state  reconstruction  where  the  estimate 
Is  permitted  to  lag  the  most  recent  measurement  time  by  a fixed  amount. 

Both  observer  types  are  useful  for  exact  state  reconstruction  during  the 


transient  period  of  an  identity  observer  where  the  latter  is  not  able 
to  estimate  the  state  accurately. 

In  the  third  line  of  investigation  into  observer  theory,  direct 
links  have  been  established  between  observer  theory,  optimization 
theory,  and  estimation  for  bandlimited,  but  otherwise  arbitrary,  signal 
processes  [42].  Still  a further  connection  has  been  made  with  the 
theory  of  system  inverses  [41].  Applications  indicated  in  [41,  42]  in- 
clude image  enhancement,  digital  picture  processing  in  the  presence  of 
severe  noise,  and  feedback  control  in  the  presence  of  intense, 
arbitrary  disturbances. 
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6.  Data  Compression  and  Random  Sampling  (Professor  A.  R.  Stubberud) 

One  advantage  of  the  Kalman  Filter  is  that  the  covariance  equation 
can  be  pre-calculated,  thus  an  error  analysis  of  the  filter  is  avail- 
able before  the  filter  is  used.  In  many  discrete  time  estimation  prob- 
lems, the  arrival  time  of  the  observed  data  is  random  and  even  though 
the  Kalman  Filter  theory  is  applicable,  the  a priori  error  analysis 
can  no  longer  be  obtained.  Research  was  performed  on  the  generation  of 
bounds  on  the  ensemble  average  of  the  covariance  matrix  when  the  data 
arrival  times  are  random  where  the  average  is  taken  over  the  ensemble 
of  all  arrival  times.  This  again  allows  a priori  error  analysis  to  be 
obtained. 

A problem  closely  related  to  that  of  random  arrival  times  is  that 
of  using  data  compression  prior  to  filtering.  In  this  problem,  the 
data  arrives  at  known  times  but  as  it  arrives,  it  is  tested  and  only  if 
it  meets  certain  criteria  is  it  processed  by  the  Kalman  Filter.  Thus 
from  the  standpoint  of  the  filter  the  arrival  times  are  random  and 
furthermore  they  are  dependent  on  the  random  properties  of  the  input 
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data.  Research  was  conducted  to  develop  bounds  on  the  average  over  the 
ensemble  of  arrival  times  of  the  covariance  equation. . These  bounds  are 
a valuable  design  tool  to  determine  the  value  of  data  compression 
techniques  in  reducing  the  amount  of  filter  processing  which  is  necessary. 
Results  of  this  study  are  presented  in  [45]. 


III.  CONTROL  THEORY 

Research  in  control  theory  has  focused  largely  on  the  develop- 
ment of  tools  for  the  design  of  multivariable  control  systems  for  both 
deterministic  and  stochastic  processes.  The  results  fall  logically  in- 
to the  four  areas  described  below. 

1.  Computer-Aided  Design  (Professor  J.  S.  Meditch) 

Two  algorithms  were  developed  and  implemented  on  the  XDS  Sigma  7 
to  effect  the  computer-aided  design  of  control  systems.  The  algorithms 
are  termed  Generalized  Polynomial  Programming  and  Adaptive  Random 
Search.  The  former  is  a new  result,  the  latter  an  extension  of  a known 
technique.  Both  have  been  used  to  solve  control  system  design  problems 
for  multi -input/multi -output  plants  which  are  subject  to  random  disturb- 
ances. The  overall  synthesis  procedure  permits  the  inclusion  of  in- 
direct saturation  constraints,  measures  of  closed-loop  sensitivity,  and 
limits  on  transient  response. 

Example  problems  which  have  been  solved  include: 
a.  Flight  control  system  for  a rigid  body  missile  to  minimize 
steady-state  position  error  for  a step  input  subject  to  a 
pole  placement  constraint  in  a region  of  the  s-plane  to 
guarantee  that  the  damping  ratio  c and  undamped  natural  fre- 
quency u>n  of  the  dominant  mode  satisfy  certain  inequality 
constraints.  The  latter  then  assures  transient  response  quality. 
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b.  Missile  roll  attitude  control  to  minimize  mean-square  attitude 
error  in  the  presence  of  wind  gust  disturbances  subject  to  a 
mean-square  constraint  on  control  surface  (aileron)  deflection. 

The  results  of  this  research  are  detailed  in  the  doctoral  disserta- 
tion of  C.  0.  oelinek  (see  Section  V).  A summary  of  the  work  appears 
in  [13]. 

2.  Design  Theory  (Professor  0.  S.  Meditch) 

It  is  well-known  that  both  classical  and  modern  control  system  de- 
sign is  considerably  more  difficult  for  multi-input/multi-output  systems 
than  it  is  for  the  single-input/single-output  case.  For  example,  the 
gain  matrix  necessary  to  achieve  a specified  closed-loop  pole  place- 
ment for  single-input  systems  via  state  variable  feedback  is  unique 
whereas  its  counterpart  in  the  multi-input  case  is  not.  To  overcome 
difficulties  such  as  this  and  greatly  simplify  the  associated  computa- 
tional problems,  a technique  for  reducing  the  multivariable  design 
prob’am  to  a single-input/single-output  problem  was  developed  and  pre- 
sented in  [26].  The  resulting  designs  are  particularly  attractive  for 
problems  involving  regulation  such  as  digital  autopilots. 

3.  Controls- Configured  Systems  (Professor  J.  S.  Meditch) 

A complete  theory  of  minimum-variance  control s-configured  systems 
has  been  developed  along  with  a highly  efficient  computational  procedure. 
The  basic  control  problem  addressed  is  that  of  specifying  the  feedback 
gain  matrix  for  minimum- variance  state  regulation  in  the  presence  of 
white  noise  disturbances  on  the  plant.  The  plant  contains  adjustable 
parameters  which  are  subject  to  inequality  constraints  and  nonlinearly 
related  to  each  other.  The  latter  constraints  and  nonlinear  dependence 
are  Included  in  the  problem  formulation.  Additional  Inequality 
constraints  on  the  gain  matrix  elements  are  also  present  to  prevent 


excessively  large  gains  in  the  closed-loop  system.  The  problem  was  re- 
formulated as  one  of  nonlinear  programming,  and  necessary  and  sufficient 
conditions  for  existence  of  a solution  were  derived.  A computer  program, 
built  around  the  Generalized  Reduced  Gradient  (GRG)  algorithm  of  Abadie 
and  Carpentier,  was  developed  to  implement  the  theoretical  results.  It 
has  been  applied  to  a lateral  autopilot  problem  in  which  the  plant  (air- 
craft) has  been  partially  reconfigured  in  specifying  the  controller.  The 
results  indicate  a 20%  improvement  in  disturbance  rejection  over  previous 
designs.  It  has  also  been  applied  to  a helicopter  hover  problem  with 
the  result  of  a 35%  reduction  in  mean-square  hover  position  error  in  the 
presence  of  random  wind  gusts  relative  to  a "conventional"  quadratic 
linear  regulator  design  under  the  same  conditions.  The  results  of  this 
study  were  presented  in  [37]. 

4.  Multivariable  Servomechanisms  (Professor  J.  S.  Meditch) 

A theory  of  system  type  for  describing  the  tracking  properties  of 
linear  multivariable  servomechanisms  has  been  developed  [38,  44].  New 
characterizations  of  system  type  have  been  formulated  and  two  systematic 
methods  for  determining  system  type  derived.  Both  methods  are  algorithmic 
and  easier  to  apply  than  the  techniques  given  in  earlier  studies.  The 
first  applies  to  the  case  where  the  open-loop  system  is  described  by  its 
transfer  function  matrix,  the  second  where  its  time  domain  state-space 
representation  is  given.  New  results  have  also  been  obtained  for 
characterizing  and  identifying  system  type  for  certain  composite  systems 
from  a knowledge  of  the  individual  subsystem  types. 

Methods  for  specifying  pre-  and  post-compensation  to  achieve  a 
desired  system  type  in  linear  multivariable  servomechanisms  have  also 
been  developed  [39].  Sufficient  conditions  have  been  derived  for  both 
forms  of  compensation  when  the  compensator  is  restricted  to  a diagonal 
input-output  representation,  and  a method  for  realizing  reduced-order 


pre-compensators  has  been  presented  for  the  case  where  the  restriction 
Is  removed. 

Certain  of  the  above  results  have  been  applied  to  a previously 
proposed  type  r multivariable  servomechanism  structure  to  obtain  a new 
configuration  [34].  The  latter  possesses  design  freedom  not  present  in 
the  first  configuration;  this  permits  optimization  of  certain  transient 
response  properties  of  the  closed-loop  system  without  affecting  pre- 
viously specified  system  type  and  closed-loop  pole  location.  An  example 
has  been  given  which  demonstrates  over  a 35%  improvement  in  integral- 
square  tracking  error  relative  to  that  for  the  original  configuration. 

The  above  work  constitutes  a complete  and  self-contained  theory 
for  the  design  of  feedback  control  systems  for  multi -input/multi -output 
processes  where  one  of  the  design  goals  is  to  achieve  certain  input- 
output  tracking  properties.  The  study  involves  the  extension  of  the 
widely  known  and  commonly  used  notion  of  system  type  from  classical 
(single-input/single-output)  control  theory  to  multivariable  systems 
as  a convenient  means  for  specifying  control  system  tracking 
characteristics. 
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